REAL-TIME INTERACTIVE ADJUSTMENT OF CONTROL PARAMETERS 
FOR A GENETIC ALGORITHM COMPUTER 

1 TECHNICAL FIELD OF THE INVENTION: 

2 The present invention relates generally to a computer system for executing 

3 software programs, particularly, to a genetic algorithm machine for executing genetic 

4 algorithms, and more particularly to a genetic algorithm machine with real-time controls 

5 in a graphical user interface that allow adjustment of certain parameters of evolution 

6 during run-time. 

7 BACKGROUND: 

8 Although evolutionary computing has roots as far back as the 1950s, genetic 

9 algorithms (hereinafter referred to by the initials GA) were introduced in 1975 by John 

10 Holland as a method for finding an optimum or near optimum solution to complicated 

1 1 problems. As noted by another researcher, Grefenstette, the GA is a useful method for 

12 finding optimum solutions to the Traveling Salesman Problem, a classic and well-known 

13 computationally intractable problem. 

14 With reference now to FIGURE 1, there is illustrated therein a conceptual model 

15 of a genetic algorithm and how a solution to a problem evolves in processing the GA, 

16 generally designated by the reference numeral 100. As is understood in this art, in a 

17 genetic algorithm, an emulated chromosomal data structure is initially designed to 

18 represent a candidate or trial solution. A number of n-bit chromosomes of that data 

19 structure are then randomly generated and are registered in groups or populations of 

20 solutions. Parent chromosomes are selected from this population of generated 

21 chromosomes according to a given algorithm, e.g., selected chromosomes 105 and 110 in 

22 FIGURE 1. Each generated chromosome is assigned a unique problem-specific fitness 

23 which may or may not differ from other chromosomes in the population, identifying the 

24 solution quality of the chromosome. The problem-specific fitness is expressed by a 

25 fitness value, as is known in the art. In a true evolutionary, survival of the fittest manner, 

26 particular chromosomes are selected from the population of chromosomes in proportion 

27 to their fitness values with more-fit chromosomes having a higher probability of being 

28 selected. 

29 As further illustrated in FIGURE 1, when a pair of parent chromosomes, e.g., 

30 chromosomes 105 and 1 10, are selected from the population, the parent chromosomes are 

31 combined using a probabilistically generated cut point, designated by the reference 

32 numeral 120. In the case of having no cutpoint generated, either of the parent 
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1 chromosomes is simply copied to provide a new chromosome as a child chromosome. 

2 Thus, a child chromosome is created and outputted. The child chromosome, therefore, 

3 contains portions of each parent or the whole portion of a parent, e.g., a child 

4 chromosome 125 contains portion 105 A of parent chromosome 105 and portion HOB of 

5 parent chromosome 1 10, as illustrated in FIGURE 1 . The child chromosome may then be 

6 mutated in a controlled manner, preferably having a low probability. In the evolutionary 

7 example illustrated in FIGURE 1 , the mutation is performed through inversion of a bit 

8 130 in the child chromosome 125, e.g., 0 to 1 or 1 to 0. A mutated child chromosome 

9 125' is then evaluated to be assigned its fitness value. An evaluated child chromosome 

10 along with its fitness value is then stored as a member of the next generation in the 

1 1 population, perhaps replacing one or both of the associated parent chromosomes 105 and 

12 110. 

13 After repeated iteration of this evolutionary process, the general fitness of 

14 chromosomes in the population improves toward the optimal solution. Thus, a solution to 

15 the problem emerges in the population, and is acquired with highly- fit chromosomes 

1 6 concentrated in the population. 

1 7 A disadvantage of the conventional GA approach, however, is that the GA is 

18 extremely slow in its execution speed when emulated by software on a conventional 

1 9 general -purpose computer. 

20 U.S. Patent No. 5,970,487 to Shackleford, et al. solved some of the drawbacks and 

21 disadvantages of prior art genetic algorithm techniques, particularly speed of operation, 

22 by the utilization of a hardware-based framework for accelerated use of genetic 

23 algorithms. The advantages and usages of the Shackleford et al. invention, Shackleford 

24 being the sole inventor in the instant application, are fully described in U.S. Patent No. 

25 5,970,487, which is incorporated by reference herein. 

26 Even though a hardware optimization may significantly speed up the performance 

27 of a genetic algorithm, it should readily be understood that hardware alone is not enough 

28 to solve many problems. Indeed, some problems may be so intractable that new 

29 paradigms of operation are required to solve them. For example, the problems of protein 

30 folding tax even the fastest computers. As is known in the art, chains of amino acids or 

31 residues make up proteins. The amino acids are, in turn, divided into hydrophobic 

32 residues which are repelled by the solvating water molecules, and hydrophilic residues 

33 which can form hydrogen bonds with water molecules. So, when a protein chain is 

34 allowed to fold and seek its lowest energy conformation, the hydrophobic residues will 

HP 10017223-1 2 



1 tend to be clustered together in the center and the hydrophilic residues will tend to be on 

2 the outside. A solution to this problem describes the complex fold patterns of the given 

3 protein. Because the protein folding problem has such a large number of possible 

4 solutions, finding a good solution using a GA machine requires approximately 40,000 or 

5 more generations of evolution. 

6 A conventional GA machine, however, may not continue evolving a solution if a 



7 good solution requires 40,000 generations or more. Depending on several input 

8 parameters, such as crossover rate and mutation rate, a good solution may take many 

9 more generations to evolve, or if the input parameters are set incorrectly, the GA machine 

1 0 may never evolve a good solution. Thus, input parameters must be carefully manipulated. 

1 1 At present, these input parameters are revised after every run either by manually rewriting 

12 and recompiling the code or by reconfiguring the hardware. 



13 There is, therefore, a present need for an improved technique to input and modify 

14 a variety of parameters into a genetic algorithm in a dynamic or run-time fashion, thereby 

15 avoiding or ameliorating the static consequences of many prior art techniques. 

16 It is, accordingly, an aspect of the present invention to provide a system and 

17 methodology whereby a user can facilitate genetic algorithm evolution by dynamic or 

18 run-time adjustments to a number of evolutionary parameters, guiding the evolution 

1 9 through direct manipulation of the genetic algorithm as a solution evolves. 

20 SUMMARY: 

21 The present invention describes a system and method to increase the performance 



22 of a genetic algorithm technique through the addition of display controls that allow 

23 human input during run-time. Adjustment of certain evolution parameters reduces 

24 processing time and increases the ability of the GA machine to evolve a best solution. A 

25 graphical interface between a user and the GA machine allows the GA to run more 

26 effectively under human guidance and direct control, without waiting between each run 

27 for the parameters to be manipulated manually. 



28 Further scope of applicability of the present invention will become apparent from 

29 the detailed description given hereinafter. However, it should be understood that the 

30 detailed description and specific examples, while indicating preferred embodiments of the 

3 1 invention, are given by way of illustration only, since various changes and modifications 

32 within the spirit and scope of the invention will become apparent to those skilled in the art 

33 from this detailed description. 
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1 DESCRIPTION OF THE DRAWINGS: 

2 The features, aspects, and advantages of the present invention will become better 

3 understood with regard to the following description, appended claims, and accompanying 

4 drawings where: 

5 FIGURE 1 illustrates a conceptual diagram of evolution in a GA machine, such as 

6 employed in the system and methodology of the present invention; 

7 FIGURE 2 depicts a flowchart illustrating the flow of a genetic algorithm machine 

8 within which the principles of the present invention may be employed; 

9 FIGURE 3 depicts a block diagram of a crossover module and a crossover 

10 template generator for combining two parental chromosomes into a single child 

1 1 chromosome; 

12 FIGURE 4 depicts the effects of changing the crossover rate on the crossover 

1 3 template generator of FIGURE 3 ; 

14 FIGURE 5 depicts a block diagram of a mutation module for mutating one or 

1 5 more bits of a child chromosome; 

16 FIGURE 6 depicts the effects of changing the mutation rate on a mutation 

17 template for the mutation module of FIGURE 5; 

18 FIGURE 7 illustrates a first representative interface screen of the present 

1 9 invention at a first setting; 

20 FIGURE 8 illustrates a second setting; 

2 1 FIGURE 9 illustrates a third setting; 

22 FIGURE 10 illustrates a fourth setting; 

23 FIGURE 1 1 illustrates a fifth setting; and 

24 FIGURE 12 illustrates a sixth setting. 

25 DETAILED DESCRIPTION: 

26 The following detailed description is presented to enable any person skilled in the 

27 art to make and use the invention. For purposes of explanation, specific nomenclature is 

28 set forth to provide a thorough understanding of the present invention. However, it will be 

29 apparent to one skilled in the art that these specific details are not required to practice the 

30 invention. Descriptions of specific applications are provided only as representative 

31 examples. Various modifications to the preferred embodiments will be readily apparent 

32 to one skilled in the art, and the general principles defined herein may be applied to other 

33 embodiments and applications without departing from the spirit and scope of the 

34 invention. The present invention is not intended to be limited to the embodiments shown, 
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1 but is to be accorded the widest possible scope consistent with the principles and features 

2 disclosed herein. 

3 The present invention provides an improvement to previous implementations of a 

4 hardware-based GA machine, such as that set forth in Shackleford et al. To assist in the 

5 general explanation of the operation of a GA machine, reference is now made to FIGURE 

6 2, which shows a flowchart of a genetic algorithm, designated by the reference numeral 

7 200, with parental chromosomes PI and P2, a child chromosome C, a mutated child 

8 chromosome C, and a fitness value F, all described in more detail hereinbelow. 



9 As illustrated in FIGURE 2, the first step is to create (step 205) a population of 

10 randomly generated chromosomes, evaluate their respective fitness values and store the 

1 1 chromosomes and their respective fitness values in a population memory 210. 

12 A parent chromosome, generally designated by the reference symbol P, is then 



13 randomly selected (step 215) from the population memory 210 and loaded as the first 

14 parent chromosome PI into a first chromosome register designated in FIGURE 2 by the 

1 5 reference numeral 220. It should be understood that when a parent chromosome is newly 

16 selected, the parent chromosome that was previously in the first chromosome register 220 

17 is then transferred to a second chromosome register 225. The first chromosome register 

1 8 220 then receives the newly-selected parent chromosome. 

19 A child chromosome C is then created (step 230) from the two parent 

20 chromosomes PI and P2 residing in the aforementioned first and second chromosome 

21 registers 220 and 225, respectively, through a crossover process, such as described above 

22 in connection with FIGURE 1. In other words, the crossover process is a single-point 

23 crossover, whereby the first and second parent chromosome registers 220 and 225 are 

24 divided, each at the same bit location, and the data to the left of that location in the first 

25 parent chromosome register 220 is used to form the left part of a child chromosome C in a 

26 child chromosome register 235 and the data inclusive of the bit and to the right in the 



27 second parent chromosome register 225 is used to form the right part of the child 

28 chromosome C. 

29 In a mutation step 240, each bit in the child chromosome C, for example, the 

30 aforedescribed bit 130 in FIGURE 1, is exposed to the possibility of mutation. After one 

31 or more bits within the child chromosome register 235 are flipped (or changed using 

32 another mechanism of random-like mutation ), the mutated child chromosome C' is stored 

33 in a mutated child chromosome register 245. In a preferred embodiment of the present 

34 invention, the probability of mutation for each bit is typically on the order of 1 percent. 
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1 After mutation, an evaluation of the child chromosome C* is made by a fitness 

2 function (step 250). A preferred fitness function is a re-configurable circuit which 

3 evaluates the problem-specific fitness of a child chromosome, as is understood in the art. 

4 Finally, the survival of the mutated child chromosome C is determined (step 260) 

5 based upon the fitness value F of the child chromosome C outputted from the fitness 

6 function 250. For example, the fitness value F of the child chromosome C is compared 

7 with the least-fit fitness value of the least-fit chromosome stored in the population 

8 memory 210. If the child chromosome C is more fit, then the child chromosome C 

9 replaces the less-fit chromosome in the population memory. If, however, the child 

10 chromosome C is less fit, then the child chromosome C is simply discarded. 

1 1 The repetitions of the steps of this process, i.e., 215 to 260, shown in double lines, 

12 improve the quality of candidate solutions toward an optimum solution. 

13 It should also be understood that after repeated iteration of this process, the 

14 general fitness of chromosomes in the population improves. Thus, a solution to the 

15 problem emerges in the population. A best solution to the problem is acquired with 

1 6 highly-fit chromosomes concentrated in the population. 

17 The present invention preferably utilizes a hardware-based GA machine, the 

1 8 methodology of which is illustrated hereinabove in FIGURE 2, with the addition of a 

19 dynamic interface. In addition to improved hardware, however, there are several 

20 evolution parameters that affect the execution speed and efficiency of a GA machine used 

21 to solve problems. 

22 With reference to the protein folding problem discussed briefly hereinabove, it is 

23 well understood in this art that a conventional GA machine requires certain parameters to 

24 be set within a range in order to evolve a good solution to the problem, and within a 

25 narrower range to evolve a good solution in an efficient number of generations. Solutions 

26 to other intractable problems have alternative ranges and preferred initial and final values, 

27 as is understood in the respective arts and in computational algorithm theory. 

28 From an instrumentational standpoint, an interface with the user, implemented, for 

29 example, on a graphical user interface through a PC, e.g., where a GA machine is 

30 encoded onto a Personal Computer Memory Card International Association (PCMCIA) 

3 1 card inserted into the PC, allows certain significant evolution parameters or variables to 

32 be changed while the GA machine is running. For instance, these variables may be: 

33 ( 1 ) the number of crossovers per run; 
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1 (2) the probability that any given bit in the chromosome will be a cutpoint for a 

2 crossover operation; and 

3 (3) the probability that any bit in the chromosome will be mutated. 

4 A user through a graphical user interface has the ability to directly change certain 

5 variables during real time operation of the GA. A possible method of implementing the 

6 effects of the changing the variables is described in detail below. 

7 With reference now to FIGURE 3 of the Drawings, there is illustrated a crossover 

8 module, generally designated by the reference numeral 300, which implements the 

9 various components employed in the aforementioned crossover step 230. The probability 

10 of crossover in the crossover module 300 can be changed, for example, by varying the 

1 1 cutpoint threshold T c . 

12 The crossover module 300 is the part of a GA machine that combines the two 

13 parental chromosomes to create a child chromosome, as illustrated and described above in 

14 connection with FIGURES 1 and 2. As illustrated, each bit of the generated child 

15 chromosome requires a two-input multiplexer to select between the two parents. In 

16 particular, a multiplexer aggregate is controlled by a crossover template, as generated in a 

17 crossover template generator. The crossover template is sent to all multplexers by a shift 

18 register, requiring one flip-flop per bit, but having the advantage of only needing two 

19 adjacent-bit connections. 

20 As illustrated in FIGURE 3, the crossover module 300 includes a crossover 

21 template generator 305, a crossover template shift register 310, and n multiplexers, 

22 collectively designated by the reference numeral 315. The crossover module 300 is 

23 illustrated with parental chromosomes PI and P2 from the aforementioned parent 

24 chromosome registers 220 and 225 in FIGURE 2, a child chromosome C from the child 

25 chromosome register 235, and bits Pli to Pl n in the bit string of length n of the parent 

26 chromosome P 1 , bits P2i to P2 n in the bit string of length n of the parent chromosome P2, 

27 and bits Q to C„ in the bit string of length n of the child chromosome C. The crossover 

28 template generator 305 generates a base serial pattern of a crossover template. The 

29 crossover template shift register 310 inputs the serial pattern, shifts the pattern bit by bit 

30 and outputs an n-bit crossover template to the aforementioned n multiplexers 315. Each 

3 1 of said multiplexers 3 1 5 performs a crossover operation on a parent chromosome based 

32 upon the crossover template. 

33 As illustrated in FIGURE 3, the crossover template generator 305 generates the 

34 aforementioned crossover template indicating a cutpoint to regulate the participation of 



1 the two parent chromosomes in the crossover process. This participation is regulated by 

2 supplying a serial pattern of binary digits (Is and Os) in the crossover template to the 

3 crossover template shift register 310. A cutpoint may be represented by a 10 or 01 data 

4 pattern so that a cutpoint can be acknowledged by that pattern appearing in the serial 

5 pattern, as is understood in the art. 

6 A cutpoint generation is performed probabilistically controlled by the following 

7 elements: 

8 (1) an externally supplied parameter cutpoint threshold value T c indicating the 

9 probability of any bit being a cutpoint, and 

10 (2) a random number stream generated by a random number generator RN A . 

1 1 The serial pattern of the crossover template is preferably generated by a toggle 



12 flip-flop 320 whose input is connected to a threshold comparator 325. As illustrated in 

13 FIGURE 3, a first input to the threshold comparator 325 is the cutpoint threshold value 

14 T c , and a second input is a random number from the random number generator RN A . As 

15 is well understood in the art, the random number generator RN A generates a random 

16 number independent from all other random numbers generated by other random number 

17 generators used in the machine. In particular, the random number generator RN A 

1 8 generates a random number in the range of 0 to r max - The mathematical probability p c of a 

19 cutpoint at any given bit is then determined by 



20 p c = T c /(r max +l) 

21 where T c is the cutpoint threshold value, as described above. It should be understood that 

22 the cutpoint threshold value T c is controlled by the user interface. 

23 As indicated by the "less than" symbol "<" within the threshold comparator 325, 

24 the threshold comparator output is a 1 when the random number is less than the threshold 

25 value T c , which causes, in turn, the toggle flip-flop 320 to change the state of its output. 

26 Thus, the toggle flip-flop 320 outputs the pattern indicating a cutpoint into the crossover 

27 template shift register 310. 

28 With reference now to FIGURE 4, there is illustrated the effects of varying the 

29 cutpoint threshold value T c on the cutpoint template. Larger values of the cutpoint 

30 threshold value T c increase the number of cutpoints per chromosome on the template; 

31 likewise, smaller values of the cutpoint threshold value T c decrease the number of 

32 cutpoints on the template. 

33 The crossover module 300 is now described more in detail further with reference 

34 to FIGURE 3. 



HP 10017223-1 



1 The crossover template generated by the crossover template generator 305 is 

2 inputted sequentially to the crossover template shift register 310 and then subjected to a 

3 bit-by-bit shifting. A bit-based shifting operation of the crossover template can provide 

4 diversity of bit position of the cutpoint in the template, which is essential to the operation 

5 of a GA machine. As the crossover template is shifted one bit to the right in the crossover 

6 template shift register 310, a new serial pattern generated by the toggle flip-flop 320 is 

7 inputted sequentially at the left-most position of the crossover template shift register 3 1 0. 

8 As shown in FIGURE 3, the crossover module 300 includes the aforementioned 

9 multiplexer 315, n of which correspond to the respective bits in the n-bit chromosome. 

10 Each of the individual multiplexers 315, for example 330, 335 and 340, corresponding to 

11 bits 1, 2 and n of the bits in the aforementioned crossover template shift register 310, 

12 include two inputs (PI and P2), an address (A) and an output (C). Each of the inputs and 

13 the address are either a zero or a one. In general, where address A is zero, the first input, 

14 i.e., PI, is selected and outputted to C, and where address A is one, the second input, i.e., 

15 P2, is selected and outputted to C. For example, with particular reference to multiplexer 

16 330, the first bit stored in the crossover template shift register 3 1 0 is zero, thereby causing 

17 selection of the value Ph, which is the corresponding bit selected from the 

18 aforementioned first parent chromosome register 220. Conversely, with particular 

19 reference to multiplexer 335, the second bit stored in the crossover template shift register 

20 310 is a one, thereby causing selection of the value P2 2 , which is the corresponding bit 

21 selected from the aforementioned second parent chromosome register 225, as described in 

22 connection with FIGURE 2. As with multiplexer 330, the multiplexer 340 corresponding 

23 to the n th bit causes selection of the value Pl„, i.e., the n* bit of the first parent 

24 chromosome register 220. 

25 The child chromosome C resulting from the crossover merger of the two 
26. aforementioned parental chromosomes PI and P2 pursuant to the crossover template 

27 mechanism is designated in FIGURE 3 by the reference numeral 350. It should also be 

28 understood that for ease of computation, the child chromosome C bit pattern is also stored 

29 in the aforementioned child chromosome register 235. 

30 A user interface pursuant to the principles of the present invention may also have 

3 1 be employed in changing other variables as well. For instance, the user may change the 

32 probability of mutation in a mutation module, generally designated by the reference 

33 numeral 500 in FIGURE 5, by changing a mutation threshold T m . As will be illustrated 
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1 further herein below, varying the mutation threshold T m has the same effect as varying the 

2 cutpoint threshold T c , but affects a more complicated equation. 

3 With reference now to FIGURE 5, there is illustrated a block diagram of the 

4 mutation module 500 in detail. It should, of course, be understood that the mutation 

5 module 500 shown in FIGURE 5 represents a presently preferred implementation of the 

6 various components employed in the aforementioned mutation step 240. As is 

7 understood in the art, the mutation module 500 randomly and probabilistically changes 

8 the generated child chromosome to insure further genetic diversity of the total population. 

9 The mutation is preferably effected by two random number generators, generally 

10 designated by the reference symbols RN B , and RN C , two bit-shift registers 530 and 535, 

11 and n AND and XOR gates, collectively designated by the reference numerals 515 and 

12 520, respectively. 



13 As generally described in connection with FIGURE 2, n bits of a child 

14 chromosome C, e.g., Q to C n , are mutated (step 240) into a mutated child chromosome C, 

15 e.g., C'i to C'„, which is illustrated in FIGURE 5 and generally designated by the 

16 reference numeral 525. 

17 If the aforedescribed crossover module 300 is deemed the primary operator of a 

18 genetic algorithm, then the mutation module 500 is the secondary genetic operator. The 

19 mutation module's chief purpose is to provide genetic diversity at a given bit position. 

20 According to a preferred embodiment of the present invention, the mutation is performed 

21 on all bits in the child chromosome C independently, probabilistically and 

22 simultaneously. Mutation is performed through inversion of a bit value, i.e., a 1 changes 

23 to a 0 and a 0 changes to a 1, e.g., the aforementioned bit 130 in FIGURE 1 . 

24 With further reference to FIGURE 5, the mutation operator 500 includes a first 



25 mutation template generator 505, a second mutation template generator 510, the n AND 

26 gates 515, the n XOR gates 520 and the mutated child chromosome 525. The first 

27 mutation template generator 505 includes the aforementioned random number generator 

28 RN B , the first shift register 530, and an absolute value comparator 540. The second 

29 mutation template generator 510 includes the aforementioned random number generator 

30 RN C , the second shift register 535, and an absolute value comparator 545. 

3 1 In this embodiment, a random pulse stream is generated respectively from the first 

32 and second mutation template generators 505 and 510 based upon two uncorrelated 

33 random numbers, i.e., RN B and RN C . The first absolute value comparator 540 receives a 

34 random number stream from the first random number generator RN B as input and 
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1 compares the random number stream with an externally supplied value representing the 

2 aforementioned mutation threshold value T m . Likewise, the second absolute value 

3 comparator 545 receives another random number stream from the second random number 

4 generator RN C as input and compares the random number stream with the mutation 

5 threshold value T m . 

6 It should be understood in this art that the mutation threshold value T m represents 

7 the probability of Is in each bit stream of Is and Os. For example, when the random 

8 number generator RN B generates random numbers from 0 to r max , then the density of one 

9 values is T m / (r max + 1). 

10 With reference again to FIGURE 5, particularly the mutation template generators 

11 505 and 5 1 0, when the random numbers are less than the mutation threshold value T m , the 

12 first absolute value comparator 540, as well as the second absolute value comparator 545, 

13 output is 1. Conversely, when the random numbers are greater than the mutation 

14 threshold value T m , the first and second absolute value comparators 540 and 545 output is 

15 0. It should be understood that a bit stream of Is and 0s from the either of the absolute 

16 value comparators 540 and 545 has a probability T m /(r max + 1) of ones in the bit stream, 

17 and the combined probability from both random number streams of a mutation p m at any 

18 bit is 

19 p m = (T m /(r max +l)) 2 

20 It should be also be noted that the shift registers 530 and 535 shift in opposite directions 

21 to better decorrelate the random bit streams, producing a "scintillation" effect. It should 

22 be understood that the series of logical ones shifted preferably have a low probability 

23 density function of about 1-10%. Therefore, at a given AND gate 515 an uncorrected 

24 probability of 1 0% for each shift register translates into a 1 % mutation rate. 

25 With reference now to FIGURE 6 of the Drawings, there is illustrated the effect of 

26 varying the aforementioned mutation threshold value T m on the mutation template, 

27 generally designated by the reference numeral 600. For example, each bit in the 30-bit 

28 chromosome in this embodiment is subjected to an increasing degree of mutation, e.g., by 

29 manipulating the mutation threshold value T m . At left, in sample 605, after 100 time 

30 steps only a small number of discrete bits have mutated with the mutation factor (y) at a 

31 relatively low setting. As the value of the mutation factor is increased in samples 610- 

32 625, the number of mutated bits on a given chromosome increases commensurately. 

33 With reference again to the mutation module 500 in FIGURE 5, the output of the 

34 absolute value comparator 540 is inputted sequentially to the first shift register 530. As 
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1 indicated by the rightward facing arrow, the first shift register 530 shifts the absolute 

2 value comparator 540 output bit-by-bit from left to right. A similar operation is performed 

3 by the aforementioned second absolute value comparator 545 and the corresponding 

4 second shift register 535, which, as indicated by the leftward facing arrow, shifts the 

5 second absolute value comparator 545 output bit-by-bit from right to left. Random 

6 numbers inputted to the absolute value comparators 540 and 545 preferably have no 

7 correlation, and therefore, bit stream patterns retained in the first and second shift 

8 registers 530 and 535, respectively, have no correlation. 

9 As shown in FIGURE 5, bits in the first and second shift registers 530 and 535 are 

10 connected to the n AND gates 515, with each gate's inputs connected to similar bit 

1 1 positions in each of the shift registers 530 and 535, e.g., bit 1 in each register connects to 

12 the first AND and bit n connects to the last AND. Each AND gate 5 1 5 thus inputs two bit 

13 values, logical ANDs the bits, and outputs a 1 only when the inputted bit values at the 

14 similar bit position in the shift registers 530 and 535 are both one. As further illustrated 

15 in FIGURE 5, the second of the AND gates 515 from the left outputs a 1 when inputting 

1 6 dual ones at the second bit positions from the left in the respective shift registers 530 and 

17 535, and so forth, as is well understood in the art. Outputs from the AND gates 515 

18 together with outputs from the aforedescribed crossover module 300, i.e., the respective 

19 bits of the child chromosome 350 (C) in FIGURE 3, are inputted to the n XOR gates 520, 

20 which performs an exclusive or of the respective bit positions of the child chromosome C, 

21 inserting a mutation at respective positions in the bit pattern of the child chromosome, 

22 when mutation is present. As is understood in the logic of this circuitry, when the output 

23 of a respective AND gate is one, the corresponding XOR gate inverts the respective child 

24 chromosome C bit, thereby inserting the mutation. Conversely, when the output of the 

25 AND gate is zero, the XOR gate outputs the value stored in the child chromosome, i.e., 

26 the XOR of dual zeroes is zero and that of a zero and a one is a one. 

27 By virtue of the aforedescribed circuitry to implement chromosomal crossover and 

28 mutation, these facets of genetic algorithms are more accessible to modification, 

29 particularly dynamic modification. As discussed, prior techniques have focused on more 

30 static, albeit high-powered, methodologies for resolving intractable, hard-to-solve 

31 problems, such as the classic Traveling Salesman Problem. Through manipulation of 

32 some run-time variables, e.g., the degree and amount of crossover and mutation, a human 

33 observer of the evolving process could guide the evolution, perhaps more quickly to a 

34 better or alternate solution than merely running the program on fixed input variables. 
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1 Indeed, with the human brain's innate complexity and the logical leaps of thought outside 

2 of the paradigms, humans could guide the algorithm toward a goal based on intuition or 

3 hunches. As with a grandmaster in chess, the mechanism to achieve a goal may be felt. 

4 Providing a tool to facilitate this approach is the focus of the instant application. 

5 Employing a dynamic interface to solve the protein folding problem, as mentioned 

6 in the Background section, is a distinct improvement over the known art and illustrates 

7 the usefulness of the system and methodology of the present invention. As is well 

8 understood in the art, the protein folding problem attempts to find a minimal energy 

9 protein configuration, i.e., a complicated three-dimensional folding of a coiled string of 

1 0 protein molecules, where some molecules or residues of the protein are hydrophobic and 

11 some are hydrophilic. As is also understood in the art, the application of a genetic 

12 algorithm to discover the minimum-energy conformation for a lattice-constrained protein 

13 is a computationally challenging problem beyond the capabilities of any computer 

14 system, i.e., the problem is NP-hard. For ease of illustration, a two-dimensional version 

1 5 of the problem is employed to simplify the tertiary and quaternary complexities of protein 

16 folding. 

17 With reference now to FIGURES 7-12, there are illustrated various specific 

1 8 effects of varying three input parameters, such as those described above. Shown in 

19 FIGURES 7-12 are examples of a presently preferred visual interface for implementing 

20 the dynamic manipulation aspects of the present invention. 

21 With reference now to FIGURE 7, there is illustrated therein a representative 

22 graphical user interface in accordance with the present invention, generally designated by 

23 the reference numeral 700. As shown, interface 700 includes a number of discrete panels 

24 such as a control panel 710 for controlling various evolutionary parameters for the 

25 problem at hand, along with a slider to implement an adjustable variable. For example, 

26 control panel 710 includes an evaluations per run parameter slider 712, which determines 

27 the length of each run, i.e., how long the population has to evolve a solution. By 

28 manipulating the slider 712, this time period is freely adjustable. It should be well 

29 understood that the slider 712 may be selected and slid via a mouse or other such software 

30 tool. Alternatively, the variable may be manipulated by a knob, joystick, touchpad, or 

31 other device. Similarly, a crossover rate slider 714 permits the user to dynamically adjust 

32 the cutpoint probability, and a mutation rate slider 716 easily allows modification of the 

33 mutation probability. As illustrated, the control panel 710 also includes a quit button 717 
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1 and a run/stop button 718, along with indicia regarding the state or degree of matching 

2 and a run counter, generally disposed above said button 71 8, as illustrated. 

3 The interface 700 further includes a cost versus evaluation panel 720, a graph 

4 which visually illustrates the pace of the evolution of the genetic algorithm in question to 

5 a good solution. A best of session panel 730 illustrates the best solution to the problem 

6 generated transfer in the session, and a best of run panel 740 illustrates the best 

7 configuration in that run. Each session is composed of a group of runs. 

8 As will be illustrated further in the exemplary evaluations that follow, a human 

9 user, by manipulating the parameters, particularly the crossover rate slider 714 and the 

10 mutation rate slider 716, may "tune in" to a good solution by using human intuition as 

1 1 well as machine computation. Finding the optimal parameter configuration allows the 

12 GA machine to evolve a best solution. Altering the parameters also allows the user to 

13 control the cost vs. evaluation curve in the evaluations panel 720, which shows how 

14 quickly the GA machine evolves a good solution. As illustrated in FIGURE 12, an ideal 

15 cost vs. evaluation curve shows an efficient evolution of a lowest-cost solution with a low 

16 amount of "noise" in the curve, as will be discussed in more detail herein below. It 

17 should be understood that the displays set forth in FIGURES 7-12 are what the user 

18 actually sees, i.e., the screen updates at 15 times or more a second and high computation 

19 rate makes the evolution appear as a continuous and quick process. In other words, the 

20 evolution process starts at the top (highest cost) and runs evaluations therefrom. When 

21 the evaluation run count (slider 712) is exceeded, another run is performed with the best 

22 solutions from the higher runs, i.e., at a lower cost. 

23 With reference again to FIGURE 7, a run with a first setting of the various 

24 aforementioned evolutionary parameters is illustrated. In particular, both the crossover 

25 rate slider 714 and the mutation rate slider 716 are zero percent, indicating that the only 

26 evolution occurring in this scenario is that two parent chromosomes are selected at 

27 random from the general population. Since no crossover occurs, one parent chromosome 

28 is selected to be the child and is copied directly as a child chromosome, as discussed 

29 hereinabove. The child chromosome is evaluated; if it is better, i.e., has a lower cost, than 

30 the parent chromosome not chosen, then the child chromosome, which is actually the 

3 1 chosen parent chromosome, replaces the parent chromosome not chosen in the population 

32 memory. This replacement process occurs until all parent chromosomes in the population 

33 memory have the same cost value with no genetic diversity and no good solution is found. 

34 The deficiency of these parameters can be seen in the flat curve of the cost vs. evaluation 
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1 panel 720 and the dissimilar solutions evolved by the GA machine. In comparison to the 

2 aforementioned ideal solution, illustrated and described in connection with FIGURE 12, 

3 the cost factor in this analysis terminates at a much higher point than the optimal solution, 

4 i.e., the cost decreases the further down the panel the analysis extents and the potential 

5 solution evolved in FIGURE 7 is poor. As shown in the panel 720, the curve flattens at a 

6 high cost, showing that that parameter setting does not allow the evolution of a good 

7 solution. 

8 In the analysis illustrated in FIGURE 7, the incorrectness of the evolution 

9 parameters may be immediately evaluated by the user. By analyzing both the cost vs. 

10 evaluation curve in the panel 720 and the displayed solutions in panels 730 and 740, the 

1 1 user may adjust the parameters to bring the parameter settings closer to optimal and to 

12 increase the efficiency of the GA machine. The user, so armed with the failure of a 

1 3 solution, may then adjust the parameters in real time so that the user does not have to wait 

14 for the machine to continue the evolution of a solution with incorrect parameters, 

1 5 immediately and better directing to a better evolution of a solution. 

16 For the protein folding problem (and indeed any intractable defined problem), the 

17 user preferably manipulates the crossover rate and the mutation rate to achieve more 

18 optimal parameter settings. For illustration purposes, the parameters will be changed 

19 separately and independently. 

20 With reference now FIGURE 8, a crossover rate slider 814 is still set to 0% and a 

21 mutation rate slider 816 is changed to approximately 1%, i.e., introducing a small degree 

22 of mutation into the mix. As with the example set forth in FIGURE 7, this approach is 

23 essentially implementing a random search and, like the previous case, does not find a 

24 good solution. The addition of mutation, in this case, however, even at a small degree, 

25 does allow for a better solution than in the previous case. In particular, the cost vs. 

26 evaluation count curve in panel 820 reaches a low cost before flattening, and utilizes 

27 more evaluations per run to reach the lower cost. 

28 In this case, the user may immediately evaluate the accuracy of the parameter 

29 settings. Although the parameter settings of this case allow a lower cost solution than the 

30 settings of the case of FIGURE 7, the GA machine is nonetheless unable to evolve a best 

3 1 solution. Therefore, more adjustment of the evolution parameters is required by the user. 

32 Because the adjustments may be made during real time, the evolution of a solution may 

33 continue without significant delay, e.g., by merely using a mouse to move a slider control. 
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1 With reference now to FIGURE 9, a crossover rate slider 914 is still set to 0% and 

2 a mutation rate slider 916 is set to approximately 5%, introducing a much larger measure 

3 of mutation into the general chromosomal population. The increased mutation rate in this 

4 case, however, degrades the efficiency of the cost vs. evaluation curve in panel 920 and 

5 increases the cost of the lowest-cost solution found from those found in the case 

6 illustrated in FIGURE 8. Additionally, too much noise is added to the random search. 

7 In this case, the accuracy of the parameter settings may be readily analyzed by the 

8 user and may be immediately seen as an improvement over the parameter settings of the 

9 first case, illustrated by FIGURE 7, but as less optimal than the settings of the second 

10 case, illustrated by FIGURE 8. More adjustment of the evolution parameters is, 

1 1 therefore, required by the user. Because the adjustments may be made dynamically or in 

12 real time, the evolution of a solution continues without significant delay. 

13 As illustrated in FIGURE 10, a crossover rate slider 1014 in this example, is still 

14 set to 0% and a mutation rate slider 1016 is changed to 10%, introducing a still higher 

15 measure of random mutation. As can be seen in the cost vs. evaluation curve in panel 

16 1020, with these parameters there is too much noise, and the curve reaches its lowest cost 

17 at the maximum number of evaluations per run. It is readily apparent that the best 

1 8 solutions found in this scenario have a higher cost than those found in the case illustrated 

19 by FIGURE 9, and higher still than the solutions found in the case illustrated by FIGURE 

20 8. 

21 In this case, the accuracy of the parameter settings may be analyzed by the user 

22 and may be immediately seen as less optimal than the settings of the second and third 

23 cases illustrated by FIGURE 8 and FIGURE 9, respectively, but an improvement over the 

24 parameter settings of the first case illustrated by FIGURE 7. More adjustment of the 

25 evolution parameters is, therefore, required by the user. 

26 The effects of the mutation rate are illustrated in FIGURES 7-10, where the 

27 examples demonstrate the bounds of the parameter required for the evolution of a 

28 solution. Of the four cases, the case illustrated in FIGURE 8 is the closest to optimal, 

29 with an optimally set mutation rate of approximately 1%. It should be apparent that after 

30 the user determines the parameter bounds of the mutation rate, the user may then adjust 

31 the other evolution parameters to achieve the optimal parameter settings. In this case, 

32 than other evolution parameter is the crossover rate modifiable via the crossover rate 

33 slider. 
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1 As illustrated in FIGURE 11, a crossover rate slider 1114 is set to 1%, while a 

2 mutation rate slider 1116 is also set to 1%. In this case, more functionality of the GA 

3 machine is used. As is readily apparent, adding crossover to mutation results in more 

4 genetic diversity and in rapid convergence of the cost vs. evaluation count towards a good 

5 solution. The curve in panel 1120 flattens at a low cost and reaches that low cost in a 

6 small number of evaluations. Indeed, the solutions of this case have a lower cost than 

7 each case presented previously, except the case illustrated in FIGURE 8. 

8 In this case, the user may immediately evaluate the evolution parameter settings. 

9 The parameters are closer to optimal than those of the previous cases but do not yet 

10 evolve a best solution. The parameters allow the evolution a solution with a low cost, 

1 1 lower than the costs of solutions evolved with the parameter settings as illustrated in 

12 FIGURES 7, 9, and 10. However, the parameter settings illustrated by FIGURE 8 allow 

13 for the evolution of a lower cost solution than that evolved with the current parameter 

14 settings. More adjustment of the evolution parameters by the user will, therefore, yield a 

1 5 better solution to the protein folding problem. 

16 As illustrated in FIGURE 12, a crossover rate slider 1214 is set approximately to 

17 5% and a mutation rate slider 1216 is set to 1%. The cost vs. evaluation curve in panel 

18 1220 is close to ideal in this case, with a rapid convergence to a best and lowest-cost 

19 solution. As illustrated, the curve in panel 1220 flattens at a low cost in a relatively small 

20 number of evaluations. Indeed, the curve here reaches a lower cost solution than any of 

21 the other cases presented above. In this case, more or less optimal settings allow rapid 

22 convergence to a best solution. 

23 In this case, the usefulness of the GA machine and interactiveness of the advances 

24 of the present invention are illustrated. The user interface that gives the user direct 

25 adjustment of certain evolution parameters of the GA machine allows the user to "tune 

26 in" to the optimal evolution parameters for an efficient evolution of a best solution. 

27 Rather than rewriting and recompiling software code to manipulate the evolution 

28 parameters, or reconfiguring hardware, the user interface allows the user to easily make 

29 modifications. 

30 The foregoing description of the present invention provides illustration and 

31 description, but is not intended to be exhaustive or to limit the invention to the precise 

32 one disclosed. Modifications and variations are possible consistent with the above 

33 teachings or may be acquired from practice of the invention. Thus, it is noted that the 

34 scope of the invention is defined by the claims and their equivalents. 



